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CLAIMS 

What is claimed is: 

1 1. A method of displaying, on a monitor having a display screen, a sign 

2 language animation of a speech component of an audio/video signal while simultaneously 

3 displaying, on the monitor display screen, a visual image corresponding to a video component 

4 of the audio/video signal, comprising the steps of: 



5 mapping the speech component to a sign language animation model to generate 

6 animation model parameters corresponding to sign language images; 

7 generating an animation signal from said animation model parameters by using a 

8 processor connected to the monitor; and 

9 rendering, from said animation signal, an animation image on a portion of the 

10 monitor, said animation image containing sign language gestures corresponding to the speech 

11 component of the audio/video signal. 



1 2. The method of claim 2, further comprising the step of receiving, before 

2 performing said mapping step, the audio/video signal at the monitor, and isolating the speech 

3 component from the audio/video signal, wherein said isolating step is performed by the 

4 processor. 

1 3. The method of claim 1, wherein the audio/video signal is provided to the 

2 monitor by a transmitter remotely located from the monitor, and wherein said mapping step is 

3 performed remotely from the monitor. 
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1 4. The method of claim 3 9 wherein the mapping step is performed 

2 proximate the transmitter. 

1 5. The method of claim 4, further comprising the step of transmitting the 

2 animation model parameters to the monitor. 

1 6. The method of claim 1 ? wherein the processor comprises a memory 

2 containing data for multiple character icons and wherein said animation image is rendered by 

3 animating a select one of the multiple character icons. 

1 7. The method of claim 1, wherein the processor is activated by selecting a 

2 function on a monitor control device. 

1 8. The method of claim 6, wherein the select one character icon includes a 

2 face having a mouth and wherein said animation image further comprises the step of animating 

3 the mouth to simulate speech corresponding to the speech component of the audio/ video signal. 

1 9. The method of claim 6, wherein said memory includes commands 

2 corresponding to a dictionary of sign language symbols and wherein said mapping step 

3 comprises correlating spoken words from the speech signal to the sign language symbols. 

1 10. The method of claim 1, wherein Synthetic Natural Hybrid Coding 

2 (SNHC) is used to generate the animation model parameters. 
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1 11. A method of displaying, on a monitor having a display screen, a sign 

2 language animation of a speech component of an audio/video signal while simultaneously 

3 displaying, on the monitor display screen, a visual image corresponding to a video component 

4 of the audio/video signal, comprising the steps of: 

5 isolating the speech component from an audio component of the audio/video 

6 signal; 

7 identifying words represented by the isolated speech component; 

8 mapping the identified words to a sign language animation model to generate 

9 animation model parameters corresponding to sign language images; 

10 transmitting the audio/video signal and the animation model parameters to the 

11 monitor; 

12 receiving the transmitted audio/video signal at the monitor; 

13 generating an animation signal from said animation model parameters by using a 

14 processor connected to the monitor; 

15 displaying a video component of the audio/ video signal on the monitor display 

16 screen; and 

17 rendering, from said animation signal, an animation image on a portion of the 

18 monitor display screen, said animation image containing sign language gestures corresponding 

19 to the speech component of the audio/ video signal. 
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1 12. The method of claim 11, wherein the processor comprises a memory 

2 containing data for multiple character icons and wherein said animation image is rendered by 

3 animating a select one of the multiple character icons. 

1 13. The method of claim 11, wherein the processor is activated by selecting 

2 a function on a monitor control device. 

1 14. The method of claim 12, wherein the select one character icon includes a 

2 face having a mouth and wherein said animation image further comprises the step of animating 

3 the mouth to simulate speech corresponding to the speech component of the audio/ video signal. 



1 15. The method of claim 11, wherein said memory includes commands 

2 corresponding to a dictionary of sign language symbols and wherein said mapping step 

3 comprises correlating spoken words from the speech signal to the sign language symbols. 



1 16. The method of claim 11 wherein Synthetic Natural Hybrid Coding 

2 (SNHC) is used to generate the animation model parameters. 

1 17. A system for producing an animation image on a monitor display screen 

2 to display, to a viewer of the monitor, sign language gestures corresponding to a speech signal 

3 derived from an audio signal component of an audio/video signal, the system comprising: 

4 a transmitter for transmitting the audio/video signal to the monitor; 

5 a receiver connected to the monitor for receiving the transmitted signal; 
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6 a memory connected to the monitor for storing sign language animation model 

7 parameters corresponding to at least one animation character icon; 

8 a processor connected to the receiver and to the memory for isolating the speech 

9 signal from the audio signal component of the transmitted audio/video signal, the processor 

10 comprising means for identifying words represented by the isolated speech signal and means 

11 for mapping the identified words to the sign language animation model parameters for 

12 generating an animation signal; and 



13 means for rendering the animation image on the monitor using the animation 

14 signal to animate the at least one animation character icon. 

1 18. The system of claim 17, wherein said mapping means comprises 

2 Synthetic Natural Hybrid Coding (SNHC). 

1 19. The system of claim 17, wherein the processor comprises a memory 

2 containing data for multiple character icons and wherein said animation image is rendered by 

3 animating a select one of the multiple character icons. 

1 20. The system of claim 19, wherein the select one character icon includes a 

2 face having a mouth and wherein said animation image further comprises the step of animating 

3 the mouth to simulate speech corresponding to the speech component of the audio/ video signal. 

1 21. The system of claim 19, wherein said memory includes commands 

2 corresponding to a dictionary of sign language symbols and wherein said mapping means 
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3 comprises means for correlating spoken words from the speech signal to the sign language 

4 symbols. 

1 22. A system for producing an animation image on a monitor display screen 

2 to display, to a viewer of the monitor, sign language gestures corresponding to a speech signal 

3 derived from an audio signal component of an audio/video signal, the system comprising: 

4 a transmitter processor for isolating the speech signal from the audio signal 



5 component of the audio/video signal, the processor comprising means for identifying words 

6 represented by the isolated speech signal and means for mapping the identified words to a sign 

7 language animation model for generating animation model parameters corresponding to sign 

8 language images; 



9 a transmitter for transmitting the audio/ video signal and the animation model 

10 parameters to the monitor; 

11 a receiver connected to the monitor for receiving the transmitted signal and 

12 animation model parameters; 

13 a memory connected to the monitor for storing an animation model of at least 

14 one animation character icon; 

15 a receiver processor for generating an animation signal from the animation 

16 model parameters for animating the at least one character icon; and 

17 means for rendering the animation image on the monitor using the animation 

18 signal to animate the at least one animation character icon. 
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1 23. The system of claim 22, wherein said transmitter processor is capable of 

2 accessing commands corresponding to a dictionary of sign language symbols and wherein said 

3 mapping means comprises means for correlating spoken words from the speech signal to the 

4 sign language symbols. 

1 24. The system of claim 22 , wherein said mapping means comprises 

2 Synthetic Natural Hybrid Coding (SNHC). 
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